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Abstract 

A method for establishing lower bounds on the number of multiplications 
and divisions has been developed by Pan, Winograd and Strassen. A similar 
method is developed for establishing lower bounds on the number of additions 
and subtractions. The results obtained partially overlap those of Belaga, 
Winograd and Kirkpatrick. 



Key words and phrases : additions, algebraic operations, algorithms, analysis 
of algorithms, computational complexity, dimensionality, lower bounds, 
optimality, polynomials, rate of growth, rational function, reduction 
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Section 1 

In this report we present a method for establishing lower bounds on 
the number of additions and subtractions required to compute rational 
functions over a field. The algorithms considered will be "straight 
line," and for the purpose of establishing lower bounds, there will be no 
loss of generality. 

For a field F, a subset H of F and a^ , . . . , a indeterminates over F, an 
algorithm over (F(a , ...,a ), H U {a^,...,a^]) consists of a sequence of 
instructions which compute elements in F(a. ,...,a ) (the set of rational 
functions in a^,...,a over F) by applying chains of algebraic operations 
(from the set {+, -, x, : ]) to elements of H U Ca-,...,a^]. 

For example, if F = IR(x) (the set of real rational functions in x) 

2 ,.2,3 

and H = IR U [x,x } then the following is an algorithm computing a^x +a2X 

2 
over (R(x,a^,a„), R U {x,x ,a.,a2}): 

1. ax *- (a2)x(x) 

2. a^ + a2X *~ (a^) + (a2x) 

2 3 2 

3. ax + a2X - (a + a2x) X x 

We have not defined the notion of an algorithm formally; for more 
formal definitions see for example [W67], [W70a], [K741. 

Section 2 

Our method for establishing lower bounds will be similar to those 
used by Pan [P66], Winograd [W67 ] , [W70a] and Strassen [S72] for multiplica- 
tions and divisions. Our results overlap partially results which were 
obtained before by Belaga [B61], Winograd [W70b] and Kirkpatrick [K72], but 
we feel that our method is useful, as it can be easily applied and permits 



certain extensions which other methods do not. The fact that similar 
approaches may be used for both multiplications and divisions, and additions 
and subtractions, seems to indicate that a general principle exists for 
extablishing lower bounds on the number of operations in computations over 
algebraic structures. 

Section 3 

We shall start with an almost trivial example which will help to 
explain the motivation behind the method. We shall take a particular 
algorithm, computing a particular function and describe a sequence of 
reductions of this algorithm. Let F = H = R and let the following be an 
algorithm over (F(a^,a , a„), F U {a-,a„,a„}) computing a^ + a™ + a,: 

1. a^ + a^ - (a^) + (a^) 

2. a^ + a- + a„ •- (a + a„) + (a^) 

This algorithm uses 2 AS ' s (additions or subtractions) to compute 
the sum of three algebraically independent elements. We shall show that 
if a^,a„,a„ instead of being algebraically independent satisfy certain 
equa ions, then this algorithm reduces to another one, which has no AS ' s 

M t , 

We first note that without AS ' s only monomials, namely elements of 

the form 

3 ... 
f 11 a'?''-^'', f P F, a(i) € Z (1) 

1 ^ 

can be computed. This statement can be proved very easily by (say) 
Induction on the length of algorithms without AS's. 



Thus, the first AS ' s in the algorithm must be of the form 

f, n af^'^^ ± f, n a^^2'^) (2) 

and indeed (a^) + (a„) is of this form. If we write the equation 
a, + a„ = J? a„ and assume that a and a^ satisfy it (Jt was chosen 
completely arbitrarily), then the algorithm computes 
a^ + a™ + a„ =iJ2 a^ + a„ by 

1. J2ia2 *- (J2')x(a2) 

2. J? a2 + a^ - ( JT^ a^) + a^ 



an 



This algorithm has only one AS, and this being a first one in 
algorithm is of the form (2). 
If we write the equation 
Jz a„ + a„ = 2a2 

and assume that a2 and a„ satisfy it (2 was chosen arbitrarily), then the 
algorithm computes 

a. + a^ + a^ = r2r a^ + a^ = la^ by 

1. J2*a2 - (r?) X (a2) 

2. 2 a2 - (2 ) X (32) 
without any AS 's. 

Let's summarize: If a , a2,a„ satisfy the equations 

a a2 = J2^ - 1 

^3^2 = 2 - yp 

then a^ + a„ + a„ is equal to a monomial and thus can be computed without 
any AS ' s . 



We shall use similar procedures to show that every algorithm computing 
certain rational functions has to have a minimum number of AS's. 

Section 4 

Let's assume now that we have four (pairwise disjoint) sets of inde- 

terminates over F: {a^,...,a^}, {b^,...,b^}, [c^,.,.,c^}, {d^,...,d^]. 

We shall actually analyze algorithms computing elements of F(ai,...,a ), 

1 n 

but we shall do it by reducing them to algorithms computing functions of 

other indeterminates. c^,...,c^, d ...,d will (intuitively) play the 

role of parameters, so that we shall (informally) assume that we "do not 

count" AS's "involving" only elements of H U {c, , . . . ,c , d, ,,..,d ]. 

1 n 1 ' n 

This will be formalized in the next definition. 

In the sequel we shall frequently use a to denote both {a,,..., a ] 

1 n 

and aj,...,a ; similarly for b, c_ and d^. 

Let's also remark that an algorithm over (F(a.), H U a) is also over 

*^F(§,»^>£>ii) > F(£>d) U { a.,bj ) and all the algorithms in the sequel may always 
be considered to be over F(a,b,c,d), F(c,d) U {a.,b]). Furthermore, 
F(£s]i.£j^) will also be considered as a linear space over F(c,d^) so we 
shall be able to say when 6^, 6^ € F(a,b,c,d) are linearly independent. 

Section 5 

Definition : An AS 5 <- 6^ ± 62 in an algorithm over (E,D) where 

E c: F(a,b,c,d), D c F(c,d) U {a,b} 

will be essential, or an EAS, if and only if 5^^ and 62 are linearly independent, 



Section 6 

Example : In the following algorithm 

1. c^ + a^ - (c^) + (a^) 

2. C2C^ + C2a^ - (c2)X(c^ + a^) 

3. (1 + C2)(c^ + a^) = (c^ + a^) + (C2C^ + C2a^) 

1. is an EAS but 3. is not (as c^ + a^ and C2C^ + C2a^ are linearly 
dependent over F(£,d)). 

Section 7 

Remark : To justify the term "essential" we remark that if 6 ^ 6^ ± 62 

in an algorithm over (F(a,b,c,d), F(c,d) U { a,b] ) is not essential, then 

it can be replaced by a multiplication. Indeed we have 

^1^1 + V2 = °' ^l'^2 ^ F(c^,...,c^,d^...d^) and w.l.o.g. f^ i 0. Then 

6;^ + §2 = (f)X(62) 

where f = -^2^\^ " ^- ^' ^^"""^ ^^ element of F(c,d) does not have to be 
computed. 



Section 8 

Lemma : Any algorithm over (F(a,b,c,d), F(c,d) U { a,b] ) which has no 

EAS's computes only elements of the form 

f^n a^'^^V^n b.P^^V, f e F(c,d) O) 

1 ^ 1 ^ 

Proof: By induction on length of algorithms. 



Section 9 

Theorem : Let G be an algorithm over (F(a.), H U a) which computes 

if (a) (= F(a) using m< n EAS's. Then there exists an algorithm B 

over (F(c,b- , ...,b ), H U {c,b, ,...,b }) without any EAS's which 
— 1 n-m ' ^— ' 1' ' n-m^ 

computes i|i (A) where 

n-m , . . , 

A. = c. n b.^^^'J^ 

and (Y(i,i)). , . , is a matrix of integers of rank n-m. 
' '-^^^1=1, . . .,n; j = l,...,n-m 

Proof : Let 

5^f naP(l'J>l f,naP(''J> 

be the first EAS in G. We can replace this instruction by a sequence 
computing na^*'-^'^'*"^*'^'^'', fof^^, f,na.^*'^'^^ using multiplications and 
divisions only, then an EAS of the form 



and then multiplication of (4) by f Ha. . Thus we may assume that 
th i first EAS is of the form 

^^ cCl.j) + ^1^ ^1 ^ p ^5^ 

If we assume that a,,,.., a satisfy 

In 

na.°'(^'j> = d, 
J 1 

then (5) reduces to d + f which is not an EAS. 



Thus we obtain a new algorithm in which the first EAS can be assumed 

to be 

n^Q'(2,j) + f2 ^ f2cF(d.) (6) 

J ^ 

(f^ € F(d ) as it may depend on the result of (5)). If a^,...,a^ satisfy 

na.^^2'^^ = d„ 

J 2 

2 
then (6) reduces to d^ t f which is not EAS. 

We repeat this procedure until there are no EAS left. Thus we 
obtain m" < m equations. 

na ""^^'J^ = d, k = l,...,m'' (7) 

such that if a ,...,a satisfy them, then the algorithm has no EAS's. 

The system (7) is a consistent system of m < n equations in n variables. 
The rank of the solution space of the homogenous system 

Ua.""^^''^ = 1 
J 

is at least n-m" s n-m. 

Therefore, for suitable cp^, ... ,cp^ 6 F(d^,...,d^) and 

/"vCi n") over Z of rank n-m (7) is solved by 

•^^^ '^^^i=l,...,n; j=l,...,n-m 

n-m , . .V 
A. = cp. n b^^^'^-* 
j=l -• 
Thus we obtain an algorithm over F(d , . . . ,d^,v,b^, . . . ,b^_^) , 

F U (d^,...,d^,v,b^,...,b^_J) computing K^i^b^^^^' ^ \ . . . .cp^Hb.^ ""'^O 

without EAS's. Similarly, we can construct an algorithm B over 

(F(c,b^,...,b^_J, H U {c,b^,...,b^_J) which satisfies the requirement 

of the theorem. It is also necessary to note that assuming that in G 

there were no attempts to divide by zero, then in B too there are no 

attempts to divide by zero. — 



Section 10 

Example : Before stating a general theorem, we shall prove that if G 
computes a, + a„ +. . . + a over (F(a), H U a), then G has at least n-1 
EAS's. Indeed, assume that G uses at most n-2 EAS's. Then the cor- 
responding B computes 

q =Scib7^^'J^ 

and the rank of (Y(k,j)) is 2. Let k be the number of distinct rows of 
Y(i,j) and thus k ^ 2. 

W.l.o.g. let i(l) < i(2) < ... < i(k) < i(k + 1) be such that 
i(l) = 1, i(k +1) = n + 1, and for every i < k the rows i(i) through 
i(Jl + 1) - 1 are equal. 

Therefore, 

k , i(^l)-l , 2 ..... .. 

q=L [ ^ c.) U b.^^^(^'>'J> 

Z=l i=i(i,) ^ j=l J 

which is not a monomial of the form (3). 

Section 11 

From here on we shall use the notation v (S) to denote the minimum 

E 

lumber of EAS's required to compute S c F(a) over (F(a), H U a) when we 

assume that it is clear what F and H are. 

Lemma : Let P ,.,.,P € F [a] (F[a] denotes the set of polynomials in a 

over F) . Let r,,...,r be monomials over F. namely elements of the form 
1 m ' 

fUa.°'^^^ , f€F 
1 ^ 

Then v^(P^,....Pj = v^(P^r^,...,P^r^). 

Proof: Trivial. H 



Section 12 

k n 



Let P = L f. n a.°'^-^' -^ be in F[a.]. (When we write such an 

j=l J A=l ^ 



equation, we shall always assume that 



1 2 J J 



Each such P can be written as 

P = f na.^'^^'^^ (s f.f -1 S 0'(J.^)-0'(«.-^))= rCl + q) where 
s J 1 J « ^=1 ^ 

]^ 
r = f Ila.°''^^'^\ q = S g.Ha/^^'"^^ for suitable |3(j,^) and g 



We have assumed that f ?^ and of course g =0. Such a 1 + q 

s 

will be called a normal form of P. We shall say that 1 +qj,..., 1 + q. 

are a normal form for P, ,...,P if each 1 + q. is a normal form for P.. 

1' m 1 1 

Let qT,...,q be like above. M, ,...,M^ of the form 
1 m It 

M. = na/(J'^) 

will be called the basis for q, ,...,q if and only if for every q. there 

^1 m 1 

exist g^,...,g € F such that 

t 

q . = S g .M. 

and {M,...,M ] is a minimal set satisfying these requirements. Such a set 
is unique. 



m 



i-*J^«Si^^^^«^ 
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11 



and we may also write 



-1 



^1^2 



^1 ^2 



We also have 



P(j,-e) 



1 


-1 


1 


1 





1 





2 



Section 14 



Theorem: 



Let P , ...,P^ e F[a]. Let 1 + q, . . . ,1 + q^ be a normal form 

j=l,.»«jt; Xr= 1 , • . • , n 
Then 



for P, ,...,P„ and let (P(j,i^)). - . , .. be the defining matrix 



m 



for the basis of q^,...,q^ 



V (P .,P ) s rank(p(j,^)), 



Proof : By the lemma in Section 11, it is enough to show that if G computes 

1 +q 1 + q , it has at least p= rank(|3( j ,^)) EAS's. Assume that G 

^2 ' ' m 

has at most p - 1 EAS's. Then by the theorem in Section 9, there exists 



12 



an algorithm B computing 



t 
[1+ Lg.M. I l<i<m] without EAS's where 



= n (c "n'''\^(^'^))P(J'^) 



J ^1 ^e=l 



n-p+1 
(c.n b ^^ '^^ was substituted for a J 

e=l ^ -^ 



n-p+1 " 



But alsoM = (nc/^J'^))n b Si Pa.^)Ya.e) 



If we define 

n 
e(j,e) = S P(j,-£)Y(^,e), 

1=1 



j = l,...,t; e= 1,..., n- p+1 

we see that g(j,e) is the product of matrices P(j,;^) and Y(j^,e) of 
ranks p and n-p+1 respectively. Therefore, 

rank(£(j,e)) s 1 

and let j be a row which has a nonzero element (and thus 

Mj ^ F(c,b^,..,,b^_ ^p - F(c)). Let i^ be such that g!"0 / 0. Then, 

using arguments similar to those of the example in Section 10 it follows that 

1 + Qj^ = 1 + S g M is not a monomial and the theorem is proved by 

j 
contradiction. □ 



II n 



13 



Before stating several corollaries we can remark that a similar 
theorem holds for rational functions. 

Section 15 

Corollary : At least 2 EAS ' s are required to compute both a, a„-a„a, and 

a, a, + a„a„ (the real and the imaginary parts of "(a- + a«i)x(ao + a,i). 

Section 16 

In the following corollaries the variables § and r\, with indices, 

will range over a,,..., a . We shall assume that variables having 
in 

different indices are distinct. Furthermore § H r| =0. 

Section 17 

Corollary : Let ? = (?(i,j)). , . , and 

1=1,. ..,m; j=l,...,n 

■n = ("nCJ.l^)) ._T . ._T be matrices. Then the product of § and r\ 
J — i,...,n; K— 1 , . . . , p 

cannot be computed with less than (m+p-l)(n-l) EAS's. n 

Section 18 

Corollary : Let F = G(x) and H = G U[x"| for some field G and an indeterminate 

n(i) . 

X over F. Let P. = S 5(i,j)x-' for i = l,...,m. Then P, ,...,P cannot 
1 (-, 1 m 

t 
be computed with less than S n. EAS's. D 

i=l ^ 



14 



Section 19 

n(i) n(i) ^ 

Corollary : S L ? (i,j,k)x-^y , i = l,...t, , cannot be computed 

j=0 k=0 

^ 2 

with less than S(n(i) + 1) EAS's where F = G(x,y), H = G U {x,yl . G 



Section 20 

Our method is capable of establishing lower bounds which at most 
equal the number of indeterminates, and thus may also be referred to as a 
dimensionality method (dimension = number of indeterminates). If now 
P € G(x) is to be computed over (G(x), G U {x}) then we should be able 
to find lower bound on the number of AS's required to compute P. Some 
results in this direction have been recently obtained by Borodin and 
Cook [B&C 74]. Their methods belong to the class of rate-of-growth methods. 

Using arguments similar to those of [K74] it is sometimes possible 
to combine these two methods. We shall describe briefly a weaker version 
of a more general theorem. 

Se : '-ion 21 

We shall assume that F = G(x), H = G U {x] and we introduce the 
notion of a weakly-essential AS (WEAS). 
Definition : An AS 6 •- 6 + 62 in an algorithm over 

(G(x,a,b,£,d) , G U {x,a,b,c,d} ) will be called weakly essential if and 
only if 

1. 5-i»5 e G(x,c,d) and, 

2. 6 and 6„ are linearly independent as elements of G(x,£,d_) when 
considered as a linear space over G(c^,d). 



15 



(Such AS CT - 6 - 62 is obviously not an EAS.) 



For a set i|r(x,a) c G(x,a.) we shall denote by v(i}f(x,a)) the 
minimum number of both EAS ' s and WEAS ' s required to compute H^ja) over 
(G(x,a), G U {x,a]). 

Section 22 

Theorem : Let n compute \|;(x,a) over (G(x,a), G U (x,a]) using v(rT) EAS's 

and WEAS's. Then there exists B over (G(x,c), G U {x,c}) which computes 

Aj(x,c),.,.,A^(x,c), ilf(x,A) e G(x,c) using at most v(G) - v (\(f(x,a)) 

WEASs. n 

Section 23 

This theorem may be used in the following way: if for a certain 
ij/(x,a), Aj(x,c),...,A (x,£), t(x,A) can be shown to require always at 
least (say) m WEAS's to be computed, then CI has at least 

v^(i);(x,a)) + m EASfe and WEASs. 



Section 24 

Corollar;^: Let G compute L a.x^" and P(x) € G(x) over (G(x,a), G U [x,a.] ) 

1 ^ 

and let m be the minimum number of WEASs required to compute P(x) over 

n . 
(G(x), G U [x]). Then as v (E a.x^" ) = n - 1 it follows that G has 

at least m + n - 1 ASs. 
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